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Copies of this report are being sent to the Director, 
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Director, Office of Science and Technology. 
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! COMPTROLLER GENERAL'S EFFECTIVENESS OF SMITHSONIAN SCIENCE INFORMATION 

: REPORT TO THE CONGRESS EXCHANGE HAMPERED BY LACK OF COMPLETE, CURRENT 

: RESEARCH INFORMATION 

Smithsonian Institution B-175102 



i DIGEST 



WHY THE REVIEW WAS MADE 



The Smithsonian Science Information Exchange is intended to be a clearing- 
house for information on current research in physical, biological, and 
social sciences. The information is compiled to facilitate more effective 
planning and coordination of research and development programs sponsored by 
Federal funds. 

For fiscal years 1963 through 1971, appropriations of about $12.7 million 
were made to the National Science Foundation for the operation of the Exchange 
by the Smithsonian Institution. Beginning with fiscal year 1972, the entire 
responsibility for the Exchange was assumed by the Smithsonian Institution, 
which received an appropriation of about $1.3 million for that year. 

Annual Federal expenditures for research have totaled about $5 billion in 
recent years. Because the Exchange can be an Important source of infonna- 
tion for coordinating Federal research, the General Accounting Office (GAO) 
has made a review of how the Exchange was run and how Federal agencies con- 
tributed to, and used, its services. 



FINDINGS AND CONCLUSIONS 



Many Government agencies are not using the Science Information Exchange to 
the fullest extent because, they claim, its data bank is not current or com- 
plete. At the same time the ability of the Exchange to provide current infor- 
mation is being hampered because the agencies are not providing the Exchange 
with the information it must have to perform the function of an information 
clearinghouse. 

Government agencies are not required to submit complete information on their 
research and development programs to the Exchange. But the Exchange cannot 
be an effective tool for coordinating Federal research without up-to-date 
information. 

A significant decline in the use of the Exchange between 19G8 and 1970 can 
be attributed, in part, to the charges levied for carrying out information 
searches of the Exchange's files. Also agencies used the Exchange less 
frequently because its information, being incomplete and obsolete, was of 
limited use to them. (See pp. 12 and 14.) 
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RECOMMEmATIONS OF SUGGESTIONS 



The Office of Management and Budget should evaluate the role of the Science 
Information Exchange as part of the Office's responsibility for fostering 
coordination of Federal programs. If it is found that the Exchange should 
be continued. Federal agencies should be required to submit pertinent, timely 
information about their research projects to the Exchange. (See p. 18.) 



AGENCI ACTIONS AND UNRESOLVED ISSUES 

Agencies and departments commenting on this report agreed that the Exchange 
would play a more important coordinating role if the agencies were required 
to provide the Exchange with information on their research projects. Agencies 
which had not submitted complete and timely information generally indicated 
that such a requirement was desirable. (See pp. 19 to 21.) 

The Office of Management and Budget agreed to study the role of the Exchange. 
On the basis of the findings of the study to be made under the sponsorship 
of ^e Smithsonian Institution, the Office will decide whether to continue 
the Exchange and whether to require agencies to report their research activi- 
ties to the Exchange. (See p. 21.) 



MATTERS FOR CONSIDERATION BY THE CONGRESS 

This report informs the Congress of a situation in which failure on the part 
of Federal agencies to report all pertinent information to the Exchange is 
hindering the effective coordination of Federal research programs. 



CHAPTER 1 



INTRODUCTION 

The Science Information Exchange^ was administered by 
the Smithsonian Institution under a contract with the Na- 
tional Science Foundation (N3F). The contract provided that 
NSF be responsible for establishing policy for the/ operation 
of the Exchange. In establishing this policy NSF was as- 
sisted by an advisory board composed of representatives of 
the National Aeronautics and Space Administration, the 
Atomic Energy Commission, the Department of Defense, and 
nine other agencies that participate in the Exchange. 

Although there is no specific legislative authority 
establlshi'.ng the Exchange, its origin dates back to 1949 
when six Govcnmient agencies and departments, engaged in 
medical research, created an information exchange to ser/e 
as a clearinghouse for in- progress scientific research in 
the medical and allied fields. The scope of the Exchange 
was expanded in 1953 to Include all life sciences research 
and in 1960 to include physical and social sciences research. 

, By ^femorandum No. 1766 dated October 24, 1964, the 
President designated the Exchange as a center for cataloging 
current and projected scientific research in all areas of 
water resources. The President stated that each Federal 
agency doing water resources research, required by the Water 
Resources Research Act of 1964 (42 U.S.C. 1961), shall co- 
operate by providing the Exchange with Information bn work 
under way or scheduled. 

Funds for the operation of the Exchange were originally 
provided by several agencies, including the Department of 
Defense, the Atomic Energy Commission, the Public Health 
Service, and the Veterans Administration. To alleviate the 
problems associated with multiagency management and fxindlng 



In Jxme 1971, the Exchange was Incorporated as a nonprofit 
corporation under the laws of the District of Columbia and 
was renamed the Smithsonian Science Information Exchange, 
Incorporated . 
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of the Exchange, the Director, Office of Science and Tech- 
nology, Executive Office of the President, re>^ested NSF in 
1963 to assume the management and funding of the Exchange 
with the understanding that the operation of the Exchange 
would continue under the Smithsonian Institution. 

For the 8- year period July 1, 1963, through June 30, 
1971, about $12.7 million was appropriated to NSF for oper- 
ation of the Exchange. Pursuant to an agreement between 
NSF and the Smithsonian Institution, all fiscal and adminis- 
trative responsibilities for the Exchange were transferred, 
effective fiscal year 1972, to the Smithsonian Institution. 
For fiscal year 1972, $1.3 million was appropriated for the 
Smithsonian Institution's operation of the Exchange. 

HO V THE SYSTEM OPERATES 

The charter for the management and operation of the 
Exchange was developed by NSF in 1964. The charter re- 
(Tuires the Exchange to develop and maintain an up-to-date 
comprehensive file, or register, of descriptive information 
concerning all types of xmclassif led scientific research 
projects in the physical, biological, and social sciences 
currently sxipported or sponsored by Federal agencies. 

The Exchange gathers current information on research 
projects undertaken by Federal, State, and local agencies 
and by nonprofit, educational, and commercial research orga- 
nizations. The information Includes the organizations per- 
forming the research, the supporting organizations, the 
title of the research project, a brief description of the 
research objectives, the names of the principal investigator 
and cclnvestigators , the period of performance, and fui^ding 
information. This Information is Indexed and is entered 
into the Exchange computer by a staff of nonprofessional 
clericals and professional scientists cuid engineers. 

Tlie Smithsonian Institution's pamphlet entitled "Sci- 
ence Information Exchange: A National Registry of Research 

in Progress" includes a list of potential uses for the Ex- 
change. The Exchange is to be used to (1) avoid duplication 
in planning new research, (2) find out what a given i»ives- 
tlgator is working on, (3) detect trends and shifts in re- 
search Interests , and (4) compare and coordinate projects and 
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programs among agencies with overlapping interests and mis- 
sions. 

According to the Smithsonian Institution, the Exchange 
is the only information system of its type in the world 
that covers all aspects of basic and applied research in a 
uniform and coherent manner so that interagency and multi- 
agency efforts can b'', quickly and xmiformly mobilized. 

Any scientist, research administrator, investigator, 
or manager can receive information from the Exchange for a 
fee intended to recover the cost of the service. The In- 
formation is available in the form of statistical summaries, 
tabulations, and complete or partial printouts. The physical 
arrangement of information can be specified by the user. 

The commonly used services of the Exchange include: 

— Subject content searches which provide Information 
on all research projects related to a specific topic. 

— Administrative content searches which provide infor- 
mation on all research projects related to a given 
county, State, or institution. 

— Investigator searches which provide information on 
research projects associated with a given name (in- 
vestigator). 

— Standard computer tabulations and listings of all 
research projects based on any selection criteria 
and arranged in various sequences with appropriate 
totals and subtotals. 

— Catalogs by research subject appropriately indexed 
to project location, investigator, and source of sup- 
port. 

—Historical searches which provide information by 
subject and administrative content on all research 
projects stored on tapes at the Exchange since 1949. 

The Exchange's data bank is updated as new Information 
is reported by organizations undertaking research. A proj- 
ect whose status has not been updated for 2 years is removed 



from the data bank and is placed on tape for storage and 
fut:ure use in hist:orical searches . As of June 30 , 1970 , 
the Exchange had received notices of approximately 91,000 
research projects that were in process during fiscal year 
1969, of which about 71,300 had been reported by 24 Federal 
agencies. The remaining research projects had been re- 
ported by 963 non- Federal agencies and commercial research 
organisations. During fiscal year 1970 the Exchange re- 
sponded to approximately 5,700 requests, including 4,000 
requests from Federal agencies. 

During the fiscal year ended August 31, 1970, the Ex- 
change billed its customers about $211,000 for services 
provided. During the same period NSF provided to the Smiths 
sonian Institution $1.6 million for support of the Exchange. 
Income from user charges Is applied against the operating 
costs and has been considered in NSF's appropriations. The 
Smithsonian Institution operates the Excheuige as a non- 
Federal private operation. 

Our review, which was conducted primarily at the Ex- 
change, was directed toward examining Into the effectiveness 
of the Excheuige and Included a review of hhe policies, pro- 
cedures, and practices of selected agencies in participat- 
ing in the Exchange. It also Included discussions with 
officials in the Office of Management and Budget and the 
Office of Science and Technology regarding their policies 
for agency cooperation with the Exchange. 



CHAPTER 2 



CCMPLETE AND TIMELY SUBMISSION OF INFORMATION NEEDED 
TO IMPROVE EFFECTIVENESS OF THE EXCHAK GE 

The primary purpose of t:he Exchange is to facilitate 
more effective planning, management, and coordination of re- 
search and development activities supported by Federal funds. 
Federal agencies have not been required to provide, and have 
not systematically provided, complete research and develop- 
ment Information to the Exchange. As a result the Exchange's 
information Is neither complete nor current. The Exchange 
therefore cannot provide Federal, State, and local agencies 
and nonprofit, educational, and research organizations with 
accurate and complete iitformation on current research and 
development projects. 

NOT ALL INFORMATION SUBMITTED TO THE EXCHANGE 



We noted that, although a high percentage of the re- 
search projects of some agencies had been reported to the 
Exchange, a significant amount of work sponsored by other 
agencies had not been reported. 

Our review of a selected sample of research projects — 
financed in fiscal year 1969 by the Office of Education, by 
the National Institutes of Health of the Department of 
Health, Education, and Welfare, and by NSF — shoved that over 
90 percent of the projects sampled were registered at the 
Exchange. By contrast the National Aeronautics and Space 
Administration submitted information to the Exchange on only 
654 of an estimated 5,000 research projects In fiscal year 
1970. The Atomic Energy Commission provided information to 
the Exchange on about 1,100 of an estimated 3,000 unclassi- 
fied research projects conducted by Its Division of Biology 
and Medicine and by its Division of Research during fiscal 
year 1970, 

Both the National Aeronautics and Space Administration 
and the Atomic Energy Commission advised us that they did 
not have explicit requirements for use of the Exchange's 
services or for the submission of information to the Ex- 
change. 



The National Aeronautics and Space Administration ex- 
plained that during fiscal year 1969 it revised its agency- 
wide system for reporting research and development project 
information and that, although the revised system provided 
less detail than did the old system, new simnnarles of proj- 
ects for fiscal years 1970 and 1971 had been submitted to 
the Exchange. Project summaries for fiscal year 1972 were 
to be subnltted to the Exchange during October 1971, and 
thereafter project simmary information was to be provided 
to the Exchange within 60 days of the beginning of each fis- 
cal year. 

The President, formerly the Vice President, of the Ex- 
change told us that he did not consider the Information sub- 
mitted by the National Aeronautics and Space Administration 
under Its new system to be adequate because the new sxnnmarles 
did not provide the detailed Information considered desirable 
by the Exchange for Individual projects. 

The Atomic Energy Commission indicated that, although 
not all Its components had submitted complete information to 
the Exchange, the Division of Biology and Medicine regularly 
submitted information to the Exchange. Our review, however, 
showed that the Division submitted Information to the Ex- 
change on only about 600 of about 1,600 research projects 
conducted during fiscal year 1970. 

Mine other agencies, which reported to NSF estimated 
obligations for basic and applied research of $13 million In 
fiscal year 1969 and $16 million in fiscal year 1970, did 
not report to the Exchange any Information on these research 
activities. 

One of these agencies was the Social Security Adminis- 
tration lidilch had estimated obligations for basic and ap- 
plied research, excluding research supported under coopera- 
tive agreements with other agencies, of $7.4 million in fis- 
cal year 1969 and $11 million in fiscal year 1970. The So- 
cial Security Administration, In commenting on a draft of 
this report, stated that in the future information on extra- 
mural research projects would be submitted to the Exchange; 
however, with respect to in-house research, the Social Se- 
curity Administration explained that It did not believe the 
Exchange was Intended to cover such research. 

12 
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The other eight agencies which did not report informa- 
tion on their research activities were the Office of Science 
and Technology, Civil Aeronautics Board, Federal Communica- 
tions Commission, Federal Home Loan Bank Board, Library of 
Congress, Federal Trade Commission, Office of Emergency 
Preparedness, amd United States Information Agency. 

INFORMATION NOT SUBMITTED TIMELY 

Our review showed that several agencies did not submit 
research information on a timely basis. Although there was 
no time requirement for the submission of information to the 
Exchange, the Vice President of the Exchange stated that, to 
achieve the maximum benefit from the Exchange, information 
on new or updated research projects should be reported within 
60 days after their initiation or after a change in their 
status . 

Our review of a test sample of information received at 
the Exchange during January, February, and March 1971 showed 
that most of the information on new or updated research 
projects had been submitted more than 5 months after the 
start of the applicable research or after a change in the 
status of ongoing projects. Some of the information had 
been reported as much as a year after the research projects 
were started or tiieir status was changed. 

For example, during the 3-month period, the Bureau of 
Mines, Department of the Interior, reported information on 
380 research projects. The information on 229 of these 
projects was reported 6 months or more after the projects 
had been started or revised. The Veterans Administration 
reported information on 194 research projects. The infor- 
mation on 134 of these was reported between 75 days and 
9 months after the research had been started. Also, the 
National Bureau of Steuidards, Department of Commerce, sub- 
mitted information in February and March 1971 for 473 of 
507 research projects at least 9 months after the projects 
were started or their status was changed. 

Various reasons were given by Federal agencies for the 
delays in submitting information to the Exchange. The De- 
partment of the Interior has advised us that it furnishes 
the Exchange with information on new research projects and 
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on revisions to existing projects annually at the time ap- 
propriations are programmed. An official of the Veterans 
Administration explained that in some cases intra-agency 
processing of reports for submission to the Exchange had 
taken several weeks. The Department of Commerce stated that 
submission of information on Bureau of Standards research 
projects had been delayed because the Bureau was engaged in 
redesigning its internal project reporting system and that 
the new system would permit future submissions to the Ex- 
change to be complete, accurate, and timely. 

AGENCIES NOT REQUIRED TO PROVIDE 
INFORMATION TO THE EXCHANGE 

Except for the President's memorandum of October 24, 
1964, requiring Federal agencies to submit research informa- 
tion on all areas of water resources, no requirements exist 
for agencies to collect and report information to the Ex- 
change on their research activities. Two studies on opera- 
tions of the Exchange concluded that more complete coverage 
of all research was needed to Improve the effectiveness of 
the Exchange. 

One study in 1964 by the Select Committee on Government 
Research, House of Representatives, concluded that the Ex- 
change had been useful and recommended that research- 
supporting departments be required to submit information to 
the Exchange so that the information in the system would be 
complete. 

The second study — which was conducted by an ad hoc com- 
mittee of users, formed by the Smithsonian Institution in 
September 1970 to review the Exchange and its future from 
the viewpoint of its value to the users — reached similar 
conclusions. The committee was composed of representatives 
of the Office of Naval Research, the Public Health Service, 
the Atomic Energy Commission, the Veterans Administration, 
and the Council on Environmental Quality and was chaired 
by the director of the Biological Science Communications 
Project of the George Washington University. The committee 
Concluded that the Exchange had been an effective organiza- 
tion in spite of its many administrative and fiscal diffi- 
culties and that the Smithsonian Institution might need to 
enlist the aid of the Office of Management and Budget to 












obtain more complete coverage of all research performed by 
the various Federal agencie3. 

Officials of the Exchange, NSF, and the Smithsonian In- 
stitution with whom we discussed the lack of a requirement 
for Federal agencies to submit information to the Exchange 
recognized that the effectiveness of the Exchange was depen- 
dent upon the Exchange's acquiring complete and current in- 
formation on research supported by Federal agencies. They 
advised us, however, that their agencies could not require 
other Federal agencies to submit information to the Exchange. 

The Office of Science and Teclinology, Executive Office 
of the President, has the overall responsibility for coordi- 
nating scientific information services within the Federal 
Government. Officials of that Office advised us, however, 
that, because of its staff position, the Office of Science 
and Technology does not have authority to direct the activ- 
ities of Federal agencies and therefore it had not formu- 
lated a policy to require Federal agencies to submit infor- 
mation to the Exchange. 

The Office of Rmagement and Budget has the responsi- 
bility and the authority for coordinating Federal agency 
programs; however, it has not required Federal agencies to 
participate in the Exchange. We discussed this matter with 
officials of the Office of Management and Budget, and they 
advised us that the Office had not issued procedures requir- 
ing agencies to report information to the Exchange because 
the procedure of permitting agencies to submit information 
on a voluntary basis had been considered adequate. 



CHAPTER 3 



LIMITED USE OF EXCHANGE 



In designating the Exchange as the infonnation center 
for water resources research, the President stated that the 
Federal agencies were expected to make fall use of the Ex- 
change, in addition to using internal inf oration systems, 
and other means which might be required for good management. 
Our review shoved that several Federal agencies had made 
limited use of the services provided by the Exchange and 
that, generally, use of the Excliange's services by Federal 
agencies had significantly declined between 1968 and 1970. 

Our comparison of statistics on several categories of 
services provided by the Exchange to Federal agencies for 
the fiscal year ended August 31, 1968, with similar statis- 
tics for the fiscal year ended August 31, 1970, showed that 
the percentage of decline in the use of these services 
ranged from 20 percent to 91 percent. The following graphs 
show, for example, that from 1968 to 1970 the number of re- 
quests for information on research performed by principal 
investigators had declined by 91 percent and that the number 
of questions associated with particular research subjects 
had declined by 68 percent. 

Officials of the Exchange explained that the decline 
in the use of the Exchange could be attributed, in large 
part, to the initiation, at various times during the fiscal 
year ended August 31, 1969, of charges for services that 
had previously been provided without cost. Charges vary 
for individual services. For example, charges for subject 
content searches ranged from $40 to $60 and for investigator 
searches were $2 for each name searched. 

The Smithsonian Institution pointed out that searches 
for research information by investigator, which represents 
about 5 percent of the Exchange's total output, decreased 
drastically as indicated by the graph on page 13 because of 
policy change:, by important users rather than because of de- 
creasing interest in the total services of the Exchange. 
This, according to the Smithsonian, had been apparent for 
some years and bad prompted the Exchange to consider offering 
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other information services in response to changing user 
needs and interests. The Smithsonian Institution advised 
us regarding subject searches that nearly all Federal agen- 
cies increased their use of this service in fiscal year 1971. 

Our review indicated, however, that the decrease in 
use of the Exchange was attributable also to the incomplete 
and obsolete data in the Exchange. Ihe Air Force Office of 
Scientific Research, which had research obligations of about 
$33 million in fiscal year 1970, made very little use of the 
Exchange's services. The Director of Defense Research and 
Engineering, in commenting on a draft of this report for the 
Department of Defense, advised us that the limited use of 
the Exchange by the Air Force Office of Scientific Research 
was attributable to the incompleteness and lack of timeliness 
of the Exchange's data base. 

The Atomic Energy Commission advised us that the prac- 
tices for using the Exchange's services varied among pro- 
grams, fundamentally as a result of the differing needs 
among Atomic Energy Commission programs for information of 
the type which the Exchange handled and also as a result of 
the var>ing adequacy of information available from the Ex- 
change. 

The Head of the NSF Office of Science Information Ser- 
vice, in a memorandxim dated August 19, 1969, to the Director, 
NSF, concerning the transfer of the Exchange to the 
Smithsonian Institution stated: 

"*** NSF's records show that its usage of [the 
Exchange], which was quite limited even when the 
service was free, dropped by 2/3 after the intro- 
duction of charges." 

••*** [NSF] certainly does not use [the Exchange] 
data for planning purposes." 

The Deputy Head, Office of Science Information Service, 
NSF, explained that, because the information in the Exchange 
was not curr'ent or complete, it was not considered useful for 
planning purposes. In commenting on a draft of this report, 
NSF stated that the information maintained in the Exchange's 
data bank had limited value in its planning and coordinating 
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of agency programs because NSF placed greater emphasis on 
infomu^tion concerning the present and future plans for the 
support of research by other agencies than on information 
concerning actions taken in the present or earlier fiscal 
years. NSF advised us, however, that the Exchange could 
provide valuable information to Federal agencies involving 
research areas which were new to them. 

Other agencies which made very limited use of the Ex- 
change's services included the National Aeronautics and 
Space Administration and the Departments of Transportation, 
the Interior, Justice, and Labor. Estimated obligations 
for research support by these agencies in fiscal year 1970 
totaled about $1.7 billion. These agencies gave the follow- 
ing reasons for their limited use of the Exchange. 

— The National Aeronautics and Space Administration 
stated that it utilized several methods to exchange 
project information directly with agencies whose re- 
search and development interests closely paralleled 
its own. These included (1) the interchange of 
personnel with other Federal agencies, (2) working 
agreements with other Federal agencies for the ex- 
change of information, and (3) membership on inter- 
agency committees through which the Administration 
keeps apprised of the research and development plans 
of other agencies. 

— The Department of Transportation stated that it had 
its own information service which integrated informa- 
tion from Exchange files with that from its own files 
concerning transportation-related infoimation and 
that, through this use of the Exchange's files, the 
Department had became aware of the Exchange's incom- 
pletenf^ss. Therefore the Department initiated efforts 
to negotiate direct agency- to-agency exchanges to 
gain access to all transportation-related research 
and development information. The Department believes 
that, as long as the Exchange's files are incomplete, 
the Exchange will be underutilized and Federal agen- 
cies will continue to make bilateral interagency in- 
formation exchange agreements despite their desire 
to use the Exchange as a central interchange facility. 




— The Bureau of Mines, Department of the Interior, 
found the Exchange's information on minerals research 
to be so limited that it was of marginal value; in 
many instances, when requesting information from the 
Exchange, the Bureau received its own previously sub- 
mitted information. 

— The Department of Justice stated that, after review- 
ing our draft report, it conducted a brief survey 
which disclosed a potentially broader use of the Ex- 
change by some of the Department's offices; however, 
prior to receiving our report, the offices were not 
aware either of the Exchange or of the extent of the 
Exchange's coverage in areas other than the physical 
sciences. 

— The Department of Labor believed that the Exchange's 
information was inadequate, uneven, and out of date 
and was oriented primarily to scientific fields 
largely outside its jurisdiction and that some funda- 
mental changes would have to be made if the Exchange 
were to work effectively in the Labor Department's 
areas of research interest. 

On January 31, 1969, Peat, Marwick, Livingston and Com- 
pany, a management consulting firm, published a two-volume 
report on the results of its broad study on Government-wide 
research and development reporting, which was undertaken at 
the request of the Office of Science and Technology. The 
report pointed out, with respect to the Exchange, that: 

— The Exchange was not widely used by agency research 
and development management for exchanging Inforr .ition 
between agencies. 

— Agency management use of the Exchange involved, to a 
large extent, functions more appropriately discharged 
by internal information systems. 

— There was a tendency for agency use of the Exchange 
to vary inversely with the effectiveness of Internal 
agency systems. Agencies having good Internal systems 
provided machinable output to, but did not often 
query, the Exchange; agencies having limited data 
processing capability made the widest use of the Ex- 
change. 



CHAPTER 4 



CONCLUSION AND PJICOMMENDATIONS 

CONCLUSION 



In our opinion, the 2xchange cannot effectively fulfill 
its purpose of providing information on active research and 
development to facilitate better planning, management, and 
coordination of research activities unless tli^ agencies vhich 
support research cooperate by furnishing current and 
accurate information to the Exchange. 

Inasmuch as the annual Federal expenditures for re- 
search total about $5 billion, the Exchange could serve a 
useful purpose by supplying information from one convenient 
central source if that source contained current and com- 
plete information on all the research efforts supported by 
Federal agencies. In view of the limited participation by 
Federal agencies in contributing information to, or re- 
questing information from, the Exchange, many managers of 
Federal research programs may not consider the Exchange 
necessary for carrying out their responsibilities. 

The Peat, Marwick, Livingston and Company, in its 1969 
study report, stated that the services traditionally pro- 
vided by the Exchange were becoming less valuable to the 
Federal scientific community and would eventually be super- 
seded through the development of internal agency systems, 
which, according to the report, were being developed 
rapidly. 

The Smithsonian Institution was not in agreement with 
the position taken in the study report because the Smith- 
sonian believed that it was unlikely that an agency's in- 
ternal automated system could provide information about 
other agencies' activities in areas of mutual interest. 

Also NSF expressed the belief, regarding the study re- 
port, that the Exchange's function should be complementary 
to, but not competitive with, information systems of the 
Federal agencies. Consistent with the study report, however. 



the National Aeronautics and Space Administration expressed 
the view that the optimum mechnisiji for exchangijig informa- 
tion on ongoing research within the Federal Government 
would be the development, by all ag^cies supporting or 
performing research, of internal systems idiich would allow 
one agency to query another's information in a network 
mode. 



Because the Office of Managcmient and Budget has 
overall responsibility for assisting in developing efficient 
coordinating mechanisms to implement Government activities 
and in expanding interagency cooperation, we discussed the 
operations of the Exchange with officials of that Office. 
They advised us that the Office had not made a decision 
concerning the mission and utility of the Exchange. Inas- 
much as it is doubtful that the Exchange is effectively 
serving its intended purpose, we believe that it is 
essential for the Office of Management and Budget to give 
timely consideration to the future role of the Exchange. 

RECC^MENDATIONS TO THE DIRECTOR 
OFFICE OF MANAGEMENT AND BUDGET 

We recommend that the Office of Management and Budget 
have a study made to determine fdiether the Exchange is 
needed. We recommend also that, if it is determined that 
operation of the Exchange should be continued, the Office 
require all Federal agencies to submit pertinent lnfonna> 
tion to the Exchange on a timely basis so that the Exchange 
can effectively serve its Intended purpose. 
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CHAPTER 5 



AGENCY COMMENTS 

We received comments on a draft of this report from 
the Office of Management and Budget, Smithsonian Institu- 
tion, NSF, Office of Science and Technology, Atomic Energy 
Commission, National Aeronautics and Space Administration, 
Veterans Administration, and Departments of Commerce; De- 
fense; Health, Education, and Welfare; the Interior; Jiistice 
Labor; and Transportation. Hie comments of the Office of 
Management and Budget, Smithsonian Institution, and NSF are 
appended to this report; comments from all the agencies were 
considered in finalizing this report. 

These agencies generally agreed with our findings and 
conclusions. Most agencies supported the principle of the 
Exchange and indicated . that the Exchange had the potential 
to provide essential coordinating services for management 
of federally and privately sponsored research activities. 
They cited, however, certain fundamental problems that ad- 
versely affected the usefulness of the Exchange. 

The Smithsonian Institution, by letter dated Septem- 
ber 28, 1971 (see app. 11), stated that it concurred in our 

finding that Government agencies had not been required to 
furnish, and had not systematically and promptly furnished, 
their total research and development information. The 
Smithsonian Institution pointed out, however, that the de- 
mand for the Exchange's services appeared to be increasing 
and that the predominant part of this increase was Federal 
use as reflected by both volume of requests and dollar in- 
come. This, according to the Smithsonian, suggests that 
Federal iisers find the Exchange to be a useful service an:' 
are willing to pay for it even though it is not complete in 
coverage. The Smithsonian said also that, as user education 
programs increased and completeness of the data bank was 
achieved, use of the Exchange could be expected to rise more 
dramatically. 

The Departments of Commerce and Labor advised us by 
letters dated September 8, 1971, and October 4, 1971, re- 
spectively, that the Exchange had not effectively served its 
purpose because of the lack of comprehensiveness and 



timeliness of the information in the system. The Department 
of Commerce expressed the view that a central, comprehen- 
sive, tinely, and accurate file of information on current re- 
search and development projects would be a usfiful and neces- 
sary tool for Federal and private managers of research and 
development activities. The Department of Labor noted that 
some fundamental changes would have to be made if the Ex- 
change is to work effectively in research areas of interest 
to the agency. 

NSF commented by letter dated October 21, 1971 (see 
app. Ill), that the Exchange had been forced to rely on 
voluntary cooperation for Information concerning agency re- 
search activities which the Exchange needed to perform Its 
fimctlon. This voluntary cooperation, according to NSF, 
had been only marginally satisfactory and was far removed 
from the level of response needed to meet the objectives of 
the Exchange. 

Most agencies concurred in our recommendation that a 
study should be made to determine the tksed for continuing 
operations of the Exchange and that all Federal agencies 
should be required to submit information on a timely basis 
to the Exchange if Its operation Is continued. 

NSF and the Department of Conmerce, however, stated 
that they did not believe a study of the Exchange was needed. 
NSF pointed out that, over the past 10 years, several surveys 
and studies of the Exchange had been made by management con- 
sultant organizations and congressional committees and that 
the Office of Management ahd Budget shduld review those 
studies and take appropriate action. 

The Department of Commerce expressed the view that an 
information system, such as the Exchange, was necessary and 
that the Department of Commerce had a strong interest in the 
effectiveness of the Exchange and In the overall Federal 
technical information system of which the Exchange was a 
part. To provide Improved public access to Federal techni- 
cal Information, Commerce established in 1970 the National 
Technical Information Service which collects, processes, and 
distributes reports on completed Federal research and devel- 
opment in much the same manner that the Exchange handles re- 
ports of ongoing Federal research and developrent. The 
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Department of Connnerce believes that the Exchange should be 
transferred to Commerce and consolidated with the National 
Technical Information Service to form a single organization 
to provide one convenient central source of information on 
Federal research and development activities. 

The Smithsonian Institution advised us that it con- 
curred strongly in the concept that mandatory input by all 
Federal agencies was most desirable at this time if more 
complete and comprehensive coverage of the Federal programs 
was to be quickly reached. The Smithsonian stated, however, 
that: it believed that the Exchange had been overly studied 
by various groups and congressional committees but that it 
would not oppose another study if the Office of Management 
and Budget believed such a study was necessary to establish 
the need for a centralized information system, such as the 
Exchange. 

Subsequently the Office of Management and Budget, by 
letter dated November 26, 1971 (see app. I) , advised us that 
it agreed with cur recommendation that further study of the 
Exchange would be appropriate at this time: and that the 
Smithsonian Institution had agreed to contract for such a 
study. The Office stated that it would closely review the 
study at each stage and that, on the basis of study results, 
decisions would be made regarding the future of the Exchange 
and the establishment of a policy requiring mandatory report- 
ing of all current and pertinent information to the Exchange. 

The Department of Transportation recommended that any 
study be conducted Jointly by the representatives of the 
executive and the legislative branches of the Government. 

The study should not be limited to a single information ac- 
tivity like the Exchange but should include the whole of 
the Federal research and development project inventory and 
reporting activities and should consider how these could be 
Interrelated and how the Exchange could help in establishing 
better and more economical interagency exchange of research 
and development management and policy Information. 

The Department of the Interior proposed that all potent* 
tlal users of the Exchange's services be afforded the op- 
portunity to develop mutually satisfactory policies of sub- 
mission, type, and form of information to be available to 
the users. , , 
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The Atomic Energy Commission stated that it believed 
that principal attention should be given to identifying the 
research and development disciplines for which there is an 
important need for Exchange services and to identifying 
the costs which would be incurred in developing and fur- 
nishing sxich Infoxmatlon in relation to the benefits ex- 
pected to be received. 
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APPENDIX I 

EXECUTIVE OFFICE OF THE PRESIDENT 
OFFICE OF MANAGEMENT AND BUDGET 

WASHINGTON. D.C. 20503 



NOV 26 1971 



Mr. A. T. Scunuelson 
Director 

General Accounting Office 
Washington, D. C. 20548 

Dear Mr. Seunuelson: 

This is in response to your letter of August 18, 1971, 
requesting the views of this Office regcurding the draft 
of a proposed report to the Congress on your review of 
the Science Information Exchcinqe. 



[ See GAO note . ] 



With regard to the recommendations in the draft report, 

I agree that further study of the Exchange would be 
appropriate at this time. The Smithsonian Institution 
has agreed to contract for such a study. The study will 
be closely reviewed at each stage by this Office. De- 
cisions regarding the future of the agency and the 
establishment of a policy requiring mandatory reporting 
of all currently pertinent information to the Exchange 
woulii be based on the results of the study. 




GAO note: Deleted conments refer to material contained 

in draft report but omitted from final report. 
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.SMITHSONIAN* INSTITUTION 

D. C. aOUfiO 
U.S.A. 



SEP 28 1971 



Mr. Lloyd G. Smith 
Associate Director 

U. S. General Accounting Office j 

Washington, D. C. 20548 

Dear Mr. Smith* 

The Smithsonian Institution has carefully reviewed the Comptroller 
General’s draft of a proposed report to the Congress of the United States 
on a *Tieviev of the Effectiveness of the Science Information Exchange - 
National Science Foundation, Smithsonian Institution" and provides the 
following comments on the review as requested. 

With regard to the Findings and Conclusions (pp. 1-2), the Smithsonian 
concurs in the finding that the Government agencies have not systematically 
and promptly furnished their total research and development information to 
the Exchange, and that they have not been required to do so. It is also true 
that usage of the Exchange was lower in FT 1970 than in FT 1968, hut it is 
respectfully submitted that this decline was the natural first reaction to 
the imposition of services fees beginning in FT 1969* at a time when agencies 
had made no provision for funds for such services previously provided without 
charge. We can state further that usage has substantially increased in nearly 
all categories of service over FJ 197 O-I 97 I, both in terms of numbers of re- 
quests and in terms of total dollar cost of all services. (See Attachments 

1—4. ) ,_ . M 1 

[See GAO note 1. p. 27.] 

The Institution concurs in the subsequent paragraphs of this section. 

In regard to the Section Recommendations or Suggestiens (pp. 2-3)* 

The Institution feels that SIE has been overly studiea already by numerous 
groups and Congressional Committees (see Attachment 5)i but would not oppose 
still another study if 0MB feels such a study is necessary to establish the 
need for a centralized information system such as SIE. 

The Institution concurs strongly that mandatory input by all Federal 
Agencies is most desirable at this time if more coi^lete and con^rehensive 
coverage of the Federal program is to be quickly reached. 

The Institution believes that the increasing demand for SIE services, 
in spite of the initiation of charges for information services, ic a good 
indication of the users* need for this type of information. The increasing 
demand for catalogs of ongoing research programs in selective areas of special 
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interest and multiagency participation further attests this need. In 
addition to the requirement for Water Resources Research, two more recent 
exan 5 )les of special interest are catalogs on Environmental Pollution and 
Pesticides in Water. Moreover, NOAA is giving serious consideration to an 
update of the Catalog of Marine Sciences Research prepared by the Exchange 
in FY 1969 . These and other selective compilations of multiagency partici- 
pation currently prepared by SIE can be quickly and more economically 
assembled from a centralized data bank with uniform indexing for all 
Federally supported research projects. 

The Institution recognized that Chapter 1 is a very sound and accurate 
description of the Exchange and a commendable synoptic summary (except for 
the figure of 1.4 million dollars of support rather than the correct figure 
of 1.3 million dollars.) 



[See GAO note 2, p. 27.] 



One of the key tables indicating declining usage was "investigator 
reports" (page l4) which decreased by from 1968 to 19?0. This product 
costs $2 per item and only represented a total income of $5»000 in lY 1970 — 
less than 5^ of the total output products. The drastic decrease in this one 
item investigator reports" was due to policy changes, by important users, 
e,g, redesigning of the research grant application form and spot checking 
instead of total checking of all investigators j rather than decreasing 
interest in the total services of the data bank. Decreasing demand for this 
one item has been apparent for some years and has prompted SIE to turn its 
attention and efforts to other lines of information services and products 
in response to changing user needs and interests. 



[See GAO note 2, p. 27.] 
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[See GAO note 2 , p. 27.] 



The Rq)ort cites the Peat, Marwick, and Livingston survey that 
"Agencies' management use of the Exchange involved, to a large extent, 
functions more appropriately discharged by Agencies' internal information 
systems". The Institution would call attention to the fact that even in 
17 1972* few Agencies have viable Internal automated Information systems 
and that the bulk of Agency requests on SIE are for information about what 
other Agencies are doing rather than information about their own internal 
programs. SIE does provide information on a given agency's internal program 
in cases where an agency does not have an internal automated information 
system of this kind. 



Another citation from the PML survey is that "Agencies having good 
internal systems provided machlneable output to but did not often query 
the Exchange". To this conclusion we submit SIE records for three signifi- 
cant information products that approximate of SIE's total output. The 
four biggest users in 17 1971 were: 



LOD 283 inquiries 

HEW 223 " 

VA I6l " 

USDA 58 " 



Two of these have well developed internal information systems of 
their own and yet they were among the four biggest users in 17 1971. 
Furthermore, the first three were also the biggest users in 17 1969 at the 
time of the PHL survey. It does not seem likely that an agency Internal 
automated system could provide information about other agencies' activities 
in areas of mutual Interest. 

Nearly all Federal Agencies actually increased their usage in the 
area of subject searches during 1971* A more complete file of research 
projects would be advantageous and would probably Increase usage. At least 
1/3 of SIE user income is contributed by Federal Agencies to prepare catalogs 
covering broad subject areas in which many agencies participate. 

In summary, the demand for SIE services appears to be increasing and 
the predominance uf this Increase is Federal use as reflected by both volume 
of requests and dollar Income. This strongly suggests Federal users do find 
SIE a useful service and are willing to pay for it even thou^ it is not 
complete in coverage. As user education programs Increase and completeness 
of the data bank is achieved use of the i^change can be e]q)ected to rise even 
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more dramatically. The avoidance of unwarranted duplications in just a 
few cases could easily save the taxpayers the cost of the entire SIE 
■budget. The need for mandatory input is obvious as it will help to make 
the data base more useful and increase the number of users of the data 
bank as has been suggested. 

Very minor changes in the text on two pages are noted and attached 
(Attachments 7 and 8). These changes are suggested to more correctly 
describe and clarify the SIE operation. 



Sincerely yours, 

' a\ • / • 

_■ . />J •o 

S. Dillon Ripley \ 

Secretary 



Enclosures 



GAO notes: 

1. All attschnents to this letter have been considered in the 
preparation of our final report but copies of the attachments 
have not been Included. 

2. Deleted comments refer to material contained In draft report 
but omitted from final report. 
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NATIONAL SCIENCE FOUNDATION 

OFFICE OF THE DIRECTOR 
Washinoton, D.C 20550 

OCT 21 1971 



Mr. Lloyd G. Smith 
Associate Director, Civil Division 
United States General Accounting Office 
Washington, D. C. 20548 

Dear Hr. Smith; 

I appreciate the opportunity to comment on the GAO draft of the 
report to Congress, "Review of the Effectiveness of the Science 
Information Exchange, National Science Foundation, Smithsonian 
Institution." 

Before commenting on the draft report, I would like to reply to 
your request, in the transmittal letter, for comments as to why 
the Foundation has not considered it necessary to make greater use 
of the Exchange for planning purposes. 

The service which the Exchange can best provide is focused on the 
record of research activity which is supported by Federal agencies 
(and other participating agencies). From this body of information, 
if maintained up to date and reasonably complete, SIE can retrieve 
a variety of useful reports, including technical information about 
individual projects. Although this sort of infonnation has some 
value in the planning and coordination of agency programs, its value 
for this purpose is limited. In planning, far greater emphasis is 
placed upon information concerning the present and future plans for 
the support of research by other agencies rather than on actions 
taken in the present or earlier fiscal years. This includes plans 
for development of new programs; changes in cnq>hasis in existing 
programs; the content and level of c\irrent year programs and related 
statistical trends for past years. Much of this information is 
undergoing change at the time it is needed, influenced by the same 
dynamic factors which influence Government policy, and it can best 
be provided by the agencies themselves. Except for the historical 
data, it is not practical to expect this sort of information, vital 
to the planning and coordination of Federal research activities, to 
be maintained by SIE. On the other hand, in looking to problem 
areas completely new to an agency, the SIE can quickly reveal a 
broad spectrum of other agency interests that provides valuable 
clues on how to start meeting new research needs. This can be 
especially valuable to agencies that are not customarily heavy 
supporters of research. 
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Concerning the draft report, our comments follow: 

Findings and Conclusions (Chapters 2 and 3) 

The report states that Government agencies have not been required 
to provide, and have not systematically provided, complete research 
and development information to the Exchange. As a result, the 
Exchange cannot provide agencies engaged in research with accurate 
and complete information on current research and development efforts. 

The Foundation believes that the findings and conclusions are a fair 
statement of the present operating problems of the Science Infor- 
mation Exchange. SIE has been forced to rely upon voluintary 
cooperation for infoimation concerning agency research activities 
which SIE requires to perform its function. This has been only 
marginally satisfactory and is far removed from the level of 
response required to meet the objectives of the Exchange. 

Under "Findings and Conclusions," it may be well to add nongovernment 
organizations to the list of important users of the services. 
Information provided to us by the SIE Council indicates that non- 
Federal users have contributed approximately one-third of the user 
charge income to the SIE during the last two fiscal years. 

Although data available through 1970 may have shown a substantial 
decline in Federal Agency use of the Exchange, probably due to the 
adoption in 1969 of user charges, we believe use has begun to pick 
up again in 1971. 

Conclusion and Recommendation (Chapter 4) 

The report notes that the Peat, Marwick, Livingston and Congany 
1969 study stated that the services traditionally provided by the 
Exchange were becoming less valuable to the Federal scientific 
community and would eventually be superseded through the development 
of internal agency systems. 

We do not believe that the furnishing of infoimation to Federal 
agencies about their own research activity was the primary goal of 
the Exchange. In our opinion, the principal benefit a centralized 
service such as SIE can perform is providing a single response to 
users about all Federal research support activity. We believe that 
SIE's function should be complementary to but not competitive with 
the information systems of the Federal agencies. 

The report recommends that 0MB conduct a study to determine whether 



APPENDIX III 



the Exchange is needed and, if so, it should establish a policy- 
requiring that pertinent information be submitted in a timely 
manner to the Exchange by, all agencies. 

We do not believe another survey of the Exchange is needed to 
e-valuate it, since there have been six critical surveys of SIE 
over the past ten years by expert management consultant organi- 
zations, and ten studies by Congressional Committees, Rather, 
we believe that the recommendation should be that CMB review 
the studies already made and take appropriate action. 

Representatives of the Foundation will be pleased to meet with 
you to discuss the draft report in more detail. 

Sincerely yours. 







MHUiM O'an 
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PRINCIPAL OFFICIALS RESPONSIBLE 
FOR THE ADMINISTRATION OF THE 
ACTIVITIES DISCUSSED IN THIS REP(«T 



Tenure of office 
From To 

OFFICE OF MANAGEMENT AND BUDGET 

DIRECTOR: 



George P. Shultz 


July 


1970 


Present 


Robert P. Mayo 


Jan. 


1969 


July 


1970 


Charles J. Zwick 


Jan. 


1968 


Jan. 


1969 


Charles L. Schultze 


June 


1965 


Jan. 


1968 


Kexmit Gordon 


Dec. 


1962 


June 


1965 



NATIONAL SCIENCE FOUNDATION 

DIRECTOR: 



H. Guyf ord Stever 


Feb. 


1972 


Present 


Raymond L. Blspllnghoff 


(acting) 


Jan. 


1972 


Feb. 1972 


William D. McElroy 


July 


1969 


Jan. 1972 


Leland J. Haworth 


July 


1963 


June 1969 


Alan T. Waterman 


Apr. 


1951 


June 1963 


DEPUTY DIRECTOR: 


Raymond L. Blspllnghoff 


Oct. 


1970 


Present 


Vacant 


June 


1970 


Oct. 1970 


Loisls Levin 


Oct. 


1969 


June 1970 


Vacant 


July 


1968 


Oct. 1969 


John T. Wilson 


July 


1963 


July 1968 


ASSISTANT DIRECTOR FOR NATIONAL 
AND INTERNATIONAL PROGRAMS 
(note a) : 


Thomas B. Oven 


June 


1970 


Present 


Vacant 


Oct. 


1969 


June 1970 
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Tenure of office 
From 

NATICTAL SCIENCE FOUNDATION (continued) 

HEAD, OFFICE OF SCIENCE INFORMA- 
TION SERVICE: 



Melvin S, Day 

John R. Pasta (acting) 

Burton W, Adkinson 


Feb. 

Jan. 

Dtc. 


1971 

1971 

1957 


Present 
Feb. 1971 
Jan. 1971 


SMITHSONIAN INSTITUTION 






SECRETARY: 

S, Dillon Ripley 
Leonard Carmichael 


Fab. 

Jan. 


1964 

1953 


Present 
Jan. 1964 


UNDER SECRETARY (note b): 
James Bradley 


May 


1970 


Present 


ASSISTANT SECRETARY (note b): 
James Bradley 


Jan. 


1961 


May 1970 


ASSISTANT SECRETARY 
(Science): 

David Challinor (acting) 
Sidney R. Caller 


Jan. 

Sept. 


1971 

1965 


Present 
Jan. 1971 


SMITHSONIAN SCIENCE 
INFORl^IQN EXCHANSE. INCORPORATED 




PRESIDENT (note c): 
David Hersey 
Monroe Freeman 


Jan. 

Sept. 


1972 

1961 


Present 
Dec. 1971 


VICE-PRESIDENT (note c): 
Vacant 

David Hersey 


Jan. 

July 


1972 

1961 


Present 
Dec. 1971 
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^Thls position was authorized by Public Lav 90-407, amending 
the National Science Foundation Act of 1950, effective 
July 18, 1968, but was not established until October 27, 
1969. 

^The Board of Regents of the Smithsonian Institution on 
Hay 20, 1970, established the position of Under Secretary 
and eliminated the position of Assistant Secretary. 

Q 

Prior to Incorporation of the Exchange in June 1971 , the 
position of president was designated director and the posi- 
tion of vice-president was designated deputy director. 












Copies of this report are a va i (able from the 
U. S. General Accounting O^f ice^ Rooni.^^G^ 7;. 
441 G Street, N W., Washiii^on^ p.C., 20648. 

Copies are provided witlKHit charge to M 
bers of Cohg^3S, congrMsi^^ 
staff nteinbers, Government officia 
of the press; col lege', librar ies ,^ faculty mem* 
bars aiNl studeinte. The; 1 ^^^ 
public is $1 ’00 ai copy. Oj^rs slmld be> ac- 
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